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ABSTRACT 


This paper explores the feasibility of fast transform 
coefficients as classification features for pulse type 
signals. The fast transforms investigated are Fourier (FFT), 
Walsh (FWT), and Haar (FHT). A synthesized signal base 
containing 79 distinct pulse shapes of similar duration 
is analyzed for classification information compactness in 
the discrete time, Fourier, Walsh, and Haar bases. Non- 
parametric information measures are used. It is concluded 
that a Fourier basis representation enables the significant 
reduction of dimensionality necessary for further study as 


a generator of classification features. 


GREE mirmotiiad Jenson | 













ul na . 

nero tanerd taxi to Sapaneay aon 
oqyd oaiug’ 40? eevviaet noxeapl baat 

, (TH) taltuot vcs betagiveevar amrotacnid a oa 

. send Lengte beybeadtoaye A CTH) aati bas , (mt 

totietbh teiisis to seqesda hia tuners et zi 

ie asentosqacs aobseetoial nottsoritassts «ot for re 

~aek .esesd seal bas .defsW ,selmol jemtt stergal 

bebekonoo sf gl .besuv enn eetldnen pitiinerctat obs 

¢reottiogts pri? eeldens solsatnesetges siasd +efeh .. 

ee (Outs teftaw? sot yiasescsn eebEsnotensmts.26 nok 

<torusae? colgapmMitsasts to Tone 


ie 


It. 


ILIEIES 


IV. 


TABLE OF CONTENTS 


TNPMIRODWCR MON), pe 12 

fo BAGRGROUND) sass ssess seas See 12 

B. SCOPE OF THE THESIS ------------—------------- 13 
1. Signal Synthesis and Data Base 

Construction -------------=——------------- 14 

2. Docmaenben Equipment -—---—-—------------- 14 

3. Theoretic Basis for the Thesis ----------- 15 

4, Results and Conclusions ------------------ / 

EXPERIMENTAL PROCEDURE ------------——------------- 18 

fs DRG) BASIE, soso scesececeaseecee: Se 18 

Bee DACA ROCE SSN Ga eee eee 2 

1. Program TRED ----------------—------------- 23 

2. Program SIFT --------------——------------- 23 

3. Program MEVAR -------------——------------- oy 

4, Program GVAR --------------—-------------- 24 

ni eproeramonRit sa2—sseees ooo 25 

SIGNAL TO TRANSFORM SPACE - PROJECTION ----------- 26 

A. TRANSFORMATIONS AND CLASSIFICATION ----------- 26 

B. THE FAST TRANSFORMS -----------—-------------- 7, 

DIMENSIONALITY REDUCTION - FEATURE SELECTION ----- 35) 

A. PURPOSE ------------------------—-—------------- 33 

B. FEATURE SELECTION ---------------------------- 38 

C. COVARIANCE AND CORRELATION ----—-------------- 38 

D. RANK ORDERING -----------------—--------------- Te 


S485 











em = nen enn tres eee ad WOLPIGIRA SAUTART 








ee ee ee oe 


eae sial Snes slasivaye a 


sucncneennmnnm {HNGtGt Cnaemieat .S 
eae G50 stead? afd ot sta obietosdT .£ 
oo eee atoleulonod Bae adtuson 8 
BAUMEVORY JATUSMIAR 





— es ee 


setae es hl acagantiinanguiatinatinns daciatintnty=htag auteszors Arad 
annem GENE adapts | Lr 
wee re en ae + + — TSIS metyoti | 
oo oe en SAVE argos 
ere ee et on AA MeegoTs 


= @ 


sy trem i ic —— TARE mevgons «2 
<—sev———~ WOFTISLONT + BOAG2 MROSEMART GT JANOEES 
iteamennen =~ WOTOTYZTESAIO GHA SHORRAIGIENART “A 
bb aint an nme LTP AR se Se 
toowe YOITORISE SAUTAM ~ HOT! 7 weet YPTIANOT cae 


ee i 


& 
wen anen nnn ne MOITAINAROD GWA OMATRAVOG o 
ona ie ne enna BO MAN AG 


Vv. DISCUSSION OF RESULTS AND CONCLUSIONS ---------- 4y 


A. INTERPRETATION OF DATA -----------------~---- 45 

1. Comments on Signal Data ---------------- 50 

2. Comments on Transform Data ------------- Be. 

B. CONCLUSIONS -------------------—------------~- 54 

APPENDIX A: GENERALIZED FOURIER SERIES -------------- 63 
APPENDIX B: WALSH/HADAMARD AND HAAR FUNCTIONS 

AND MATRICES —-------------——----------___ 66 

APPENDIX C: LISTINGS OF FAST TRANSFORM SUBROUTINES -- 71 

APPENDIX D: TABULATION OF NUMERICAL RESULTS --------- om 

LIST OF REFERENCES —--------------------__-___________ 94 

INITIAL DISTRIBUTION LIST ---------------------------- 96 

FORM DD 17 steeeenee mem Choe is Dee eee eee eel. 97 


aa 


ae 
02 
52 
Be 
£9 


ae 
iT 
TY 
we 
a0 
Fe 














— SauTTVORAVE MAOTEMART TART TO BoMITeII 3D xe 
oa ==— BNIVERA IASTASMUM TO MOTTAMUAAT 
AD ee ee! SISDVIRSI ‘ a 


ener ncictaireeemsneen nee SEE MODI 





TABLE 
D1. 


D2. 


D3. 


D4. 


D5. 


D6. 


D7. 


D8. 


D9. 


D1O. 


LIST OF TABLES 


TITLE PAGE 


Feature Selector (F-Ratio) Test 
on Signal Samples of 20 Classes 
(=i o 0) = SS Tah 


Feature Selector (F—-Ratio) Test 
on Fourier Magnitude Coefficients 
of 20 Classes (6-11 to 10-12) -—---------- 79 


Feature Selector (F-Ratio) Test 
on Walsh Coefficients of 20 Classes i 
(6-11 to 10-12) -----------——------------ 80 


Feature Selector (F-—Ratio) Test 
on Haar Coefficients of 20 Classes 
(6-11 to 10-12) -----------—------------- 82 


Feature Selector (F-Ratio) Test on 
Fourier Magnitude Coefficients of 
79 Classes ----------------=—------------ 84 


Feature Selector (G-Variance Ratio) 
Test on Fourier Magnitude Coefficients 
of 79 Classes --------------------------- 85 


Feature Selector (F-Ratio) Test on 
Walsh Coefficients of 79 Classes -------- 86 


Feature Selector (G-Variance Ratio) 
Test on Walsh Coefficients of ne 


(Cle SSCS 88 


Feature Selector (F-Ratio) Test on 
Haar Coefficients of 79 Classes --------- 90 


Feature Selector (G-Variance Ratio) 
Test on Haar Coefficients of 79 Classes - 92 


OB 


28 


oe 


BE 





saat (oltoak-F) a 


nefoltteod shysingsM + 
SLasciese tal (SI-OL oF ita) esexsin . 


teat (otteai-t) todostes emitsel 























eseesiD OS "lo einetoMiedD defe¥ ao 


a wnevee (SI-OL \09), Af-8) 
tael (olteh-I) tosoekee emiact 

eseesfD OS Yo atnsfoltt gaat a0 

w+ es mmm (SloOf oF If-3) 
no ges (olyal-f) tos stuIael 

Y edsolsl¥teod sbudl teltuct 

ae —-—a— pogestS ey 

(olssh sonsiva¥-~0) 10¢00fe8 s4paae4 
eiaeltolvised ebutingaM tele! gp tueT 

a a a ate a oe we —cow——e--—— £968R£9 OF to 
no Jae? (oliah-T) tosoele® etuteat 

wasn am SH6eBI PT to atagho Migeod dale 


(ol7BR esoasicav 


e 


% 


30 setnsict 


-0) tofoelse saggecl 
11900 deieW ao dgeT 


SO ee en eee ‘Spee RID 
P 
% 


———eenee et e LS) 


- #one 


wo Jas? (olse®-T) rotvefek etytact 
‘\ Yo etavlolitead saak 


{o 
el 


ols 
2 


ia) 


af eons l4 
eT 


a 
~ 


iatot’ 


sV-D) sotoele® ‘apgdae4 
1909 rssh a6 JgaoT 





FIGURE 


13. 


14. 


15. 


LIST OF ILLUSTRATIONS 


TITLE PAGE 
LINE PULSER AND PULSE ENSEMBLE ------------- 19 
LINE CONFIGURATION FOR SIGNAL CLASS 2-7 ---- 20 


DATA FLOW AND FORM DURING DATA BASE 
CONSURUCHNON ens = ee se 22 


3-AXIS PLOT OF PROTOTYPE SIGNALS OF 
THEML OR CUACSH Sim ae ee ee eee 29 


3-AXIS PLOT OF THE FOURIER PROTOTYPES 
OF (UHI 7OY GRASSES (Se etes om ee 30 


3-AXIS PLOT OF THE WALSH PROTOTYPES OF 
Imo (9) CHASSIES aadasea see 31 


3-AXIS PLOT OF THE HAAR PROTOTYPES OF 
THE 79 CLASSES ----------------——------------ 32 


HYPOTHETICAL 2-CLASS PROJECTION ONTO 3 
ORTHOGONAL AXES -------—-—-----—=——-—————-—-——---— 35 


3-SPACE Geet ren OF ALL cBEN ORDERED 


3-VECTORS (I,, I,, I,) ------+——------------ ho 
OVERLAID PLOTS OF THE PROTOTYPE SIGNALS 
OF 79 CLASSES ---------------+——---------_-- 46 


OVERLAID PLOTS OF THE FOURIER PROTOTYPES 
OF 79 CLASSES -----------------—------------ 47 


OVERLAID PLOTS OF THE WALSH PROTOTYPES 
OR 79) CLASSES) an eee 48 


OVERLAID PLOTS OF THE HAAR PROTOTYPES 
OF 79 CLASSES ------------------------------ 49 


F-RATIO TEST INFORMATION MEASURE OF 
REPRESENTATIONS IN THREE BASES FOR ALL 

79 CLASSES AS FUNCTIONS OF TEST RANK 

IOI OE ee 55 


G-VARIANCE RATIO TEST INFORMATION MEASURE 
O REPRESENTATIONS IN THREE BASES FOR ALL 
79 CLASSES AS FUNCTIONS OF TEST RANK INDEX - 56 


eL 
os 


ss 


es 


tes eee i 9th i a a — 2392429 8T TO 
TO oe AOITAMACEUI TeSy OTTAA-<G 
JIA f#Oo® edz A SPAT UL SHOTTAPIReear Tak 
AMAR TRAN — SMOITINUN BA BRBRAIS ST 

Vi tne mee ES ee ttc tana dee ear pagal yon 
att) BAS - QOITAMAOTH reaT OITAN ROMAEAAV <5 
ITA ' Beas w SAR (lL SUOTTATHSCANSEA O 





somes St em 


<< T=S- 2240) IAI HOT 


BGAA ATAL OMIAUC NAOT ATAd 
en ee ee 


‘0 BJAMDI2 ATYTOTORT z: M 2IxA-£ 
—a Qy sar 


Se 





co ee ete 





S99YTOTOAT ARIAUOCT ZHT FO TOIT arxa-F 
ey SHT =O 


ee 


TO BETFPOTONT H&JAW ZH? BO ZIXA-E 
siabaso ey Sit 





oe 


—a7 ame 








TW SBTTOTONT AAAH aHY MOOgds RIth-€ 
SE8GAID OY BHT 

£ OTHO MOITOULORT 22Ac0-$ ITSHTOTYH 

-———~ SLA AAWOOOHTHO 


Q3ASCHO AKAH JIA I WOITATHSESAGAR BOAIS~-E 
‘ex « gi a | tj SBA0OToaV~E 


SIAMOIS StrTTOTOR’ GHT 90 SRARP GEAJAZVO 
nnn a= SRBBAD OT TO 


ESTYTOTORY ASIGVOT SHT TO SFOM AAJA 
Ho nae een nngenemece CRARREIMQT IO 


PSIYTOTORT HOJAW BH? @O-ePONS MBAIMAVO 
a= omnes BENEAD OT. TO 








=——_ 





SS A Re RN RES SO ee 





oe 





BSTTTOTOAY RAAH EMT FO ETOIG GAAaVO 





«» RAVI = i Te2aT WO EKO TT AUT 2A SSCRALO OF 


16. 


17. 


18. 


19. 


20. 


el. 


AZo 
ASio 
24. 
25. 


F-RATIO TEST INFORMATION MEASURE 

OF FOUR BASIS REPRESENTATION FOR 

20 CLASSES (6-11 TO 10-12) AS 

FUNCTIONS OF TEST RANK INDEX ------------ 


OVERLAID PLOTS OF THE 25 SIGNALS 
DEFINING CLASS 9-11 --------------------- 


OVERLAY OF THE 25 SETS OF FFT 
COEFFICIENTS OF THE SIGNALS 
OIMIHONE CHINSS Oa Spo 2 eS es 


OVERLAY OF THE 25 SETS OF FWT 
COEFFICIENTS OF THE SIGNALS DEFINING 


OWAGS OSL Sebo as 


OVERLAY OF THE 25 SETS OF FHT 
COEFFICIENTS OF THE SIGNALS DEFINING 
CLASS 9-11 ---------------=------------=--=- 
F-RATIO TEST INFORMATION MEASURE OF 
SIGNAL SAMPLES FOR 20 CLASSES (6-11 

TO 10-12) AS A FUNCTION OF SAMPLE 

INDEX ---------------------- === --------=-- 
CONTINUOUS WALSH FUNCTIONS OF ORDER 8 --- 
WALSH SEQUENCY MATRIX OF ORDER 8 -------- 
CONTINUOUS HAAR FUNCTIONS OF ORDER 8 ---- 


ORTHOGONAL HAAR MATRIX OF ORDER 8 ------- 


D7 


58 


59 


60 


82 


8? 


Od 


a 


‘$3 


7a 
8a 
20 
SY 








OF > Mictacs Ian ele s wT 
GA (Si-OL OT 11-3) 28 2 
XS0KT AMAA T2ST FO SOT 





GIAMOTe 2S SAT FO TOT | 
Li-8 GeAd: 


BB Li Se SET 46 
SJAMOLE BHT Go 
ff-2 22ad9 


TWH 40 aTa2 Serhg 
- ORIENT ena Gu? 40 


THT O-eTas 2S AHT oo 
OMIMIYSS SJAROIZ FHT FO 


TO BHUSARM MOTTAMAOWMY TAS? OTPAN-@ 
fr-3) GERZAM9 OS AOT aia 
SIMA WO YOITOKUT-A BA =0f 07? 


ee CH? a ee qe ee xauuT 















——— — oe 





-<—« § AMONG 9O BHOTTONUY HelaWw BUOUMITEOD 
-—-—e § REINO TO XIATAM YOMSURES ASLAW 
_-—— 8 REINO WO EMOYTOMUT RAAB BOODMITHOD 
nana §-(GOHO FO XIATAM-AAAR RAMODORRAD 


DEFINITION OF SYMBOLS AND TERMS 


DEFINITION 


A matrix having M rows and N columns. 
The matrix transpose of A. 


The signal space vector representation of 
the k-th signal of the m-th class. 


The elements of g(m) which are samples of the 
indicated signal taken at time instants 


nen = O08 2) 2.2.5 N—-l and) ZT is) the sampile 
interval. 
The approximator or estimate of sont). 


The transform space vector representation 
of the k-th signal of the m-th class. 


The ain dimensional component or coefficient 
of xm ; 


Dimensionality of the space concerned. 
Cardinality of signal classes in the space. 
Cardinality of signals inthe m-th class. 


Estimated mean vector or 
m k=1 Prototype for class m. 


The n-th dimensional component of the Protytype. 


m i 
ae xm - ees Estimated variance 
vector of class m. 


.ermrloo H bos awor M gatved xiivam A 
A To secqeasts xPisam dat 


Yo molttsinssetqe: tososy soaqa [emits sdf 
+5eefo tam ei? 10 Eenpee dao sat 


edz to eslqmss ets fotcw Vi) 16 einemelis saT 
sinsteant emtd 35s nedsd ~ Lengie befeotoat 
efonse sift ef T bas I-H ,.... £450 2 nm’, Te 
sfavestat 


nn) Me to sJanlise 16 tovem—Reaqgs oT 


noljadneeetget icyo9sv soaga orypOternead act 
,sanlo di-a add to Langra dfal ed? Io 


SnaloltTYieos to Iaenoqmos Isnolenemsd a sdiT 
‘ Bry » Fe) 
,bentTSsenes eosqe 447 10 yo tiemotanemt¢ 


9080 orig at eseasio [angle Yo yilentprs 


san{s dt-o env’ al olemeiec Yo ye Sieasbasl 
; 2 


qi 
7 fia) ad Zz 
To tolfsew Geem besamizead .* ~ 3 a . 
. seats so? eayvtosor? . i | 


qvutyioxut of? lo drnenpqmoes lanotaneanls Gi=a gat 


; os 
(ma) 
sinefesny beteanigex Sp (i 


AAL ret : t y -. we) 7 Ta a 
R to TtoOsgeyv {a 


B 





SYMBOL 


g2(m) 
n 


Pn 


27a 


A/D 


FFT 


FHT 


FWT 


Global 


Class 


Cluster 


DEFINITION 


The n-th dimensional component of the 
variance vector of class m. 


The relative current probability that an 
observed signal should associate with class 
mM. 


Covariance matrix. 
Correlation matrix. 


The i-th eigenvalue of the real-symmetric 
matrix C. 


Analog to Digital (continuous to discrete) 
conversion. 


Fast Fourier Transform. 
Fast Haar Transform. 
Fast Walsh Transform. 


The whole space, meaning consideration of 
all dimensions. 


The representations of signals from the 
same source. 


The collection of points in N-space formed 
by representations of signal of a common 
elass. 


or eee aaa oes sta 
a 


an tact iilidsdory tnevte ssttuis meee ont 7 
gaalo Attw etatoowes biuords peers h cpt a 


‘xtrddm-segmeey CO 
-kitses nobealetip2 
. 


oltiemmye<Lse1 ef’ to sulavnagte @9<2 eAT 
-Q attssa 


(eistoelb ov evourntinos) {s7tald oF . 
: Noo 


-pactann:T *slttuo® yast 
-wiolanstT taeW test 


wie'tanesT delsW fest 


t¢ aolvsreblenes gainsea ,scagqs siege osF 


Lentlenangh tke‘ 


ai! mot? eletgie Io enoltainssssqes Sar 
[$0%U08 SCRE 


‘omc’ sosge-K nt adniog 36 aéligelion wef 
mes € to Ddanmle to snof a Pe 





i) 
~ 
= 


a 





TERM 


Category 


Signal Space 


Transform Space 


Feature Space 


Coefficient 


Feature 


Metric, or 
Measure 


Prototype 


DEFINITION 


The collection of all possible classes to 
be considered. 


The N-dimensional vector space equivalent 
to the discrete time domain. Its basis 
is the N-set of block pulses. 


The N-dimensional vector space with an 
orthonormal basis defined by the N 
transform basis functions. 


The R(< N) - dimensional vector space 
formed by discarding selected dimensions 
of another space. 


The projection onto a dimension of the 
transform space. 


A coefficient selected for use in the 
classification process. 


A function d(a,b) satisfying: 
ee mC arb) ape Om Wee nurequiakt tiv) tetera=: (Dis 
Ze GGasib) m=" diGbna). 
Sem dab) sat acdi(bmic) sre dGay.c).. 


The best estimate of the true representation 
forvanciasisi. 


10 


7 a Pe Bie ie2 






6? seeesto scones Ep Ser 


“es a 


“dinetewtupe cai Soe 
staad iI .atemob amt? sven vat os 
-eoelug soold ple ? 


mm dAtio enaqé ToOsosv Rinse eat s0sge) 
“ edt vd Bentited elsad . 
senolionvt utead 


onsqe iotoev Tanotansmib - (WH 216 ear. 
snetamemtb betoslee aniiaesels ¥ . 
.s2sqe Telons To 


eri? Io dofememth 8 otco nolfoslong oAT 
.scage arian 


ace al aki 161 betosfies Iretoltiece A 
-2asco%g solves tl tiegals 


maniyietiea (4,8)) motdoml? A 
.d © @ t24 ytilevpe deiw 0 ¢ (de 4 
-(s,.¢)6 rs td, #)t a 
-(o,2)b <~ (5,0)5 + (d, pI8 4f 


“of @atnet@rqe: ovt? of? to siemtize feet. saz 
-acelo «2 TH 


of 


ACKNOWLEDGEMENT 


I am deeply grateful to ESL, Inc. of Sunnyvale, Calif., 
for the use of their facilities and the assistance and 
experience of their personnel. But I am particularly 
indebted to my wife, Barbara, whose help and unwavering 


devotion made this work possible and to whom it is dedicated. 


11 





-bodaothad at 2) medw o¢ brs Naeem shat 
. > fe 


> OE 


; 


ti 


I. INTRODUCTION 


A. BACKGROUND 

Radio-fingerprinting or signal source identification has 
been regarded with varying degrees of skepticism over the 
years. Early attempts at radar fingerprinting were based 
on at most three parameters; signal carrier frequency (RF), 
“pulse repetition frequency (PRF) or interval (PRI), and 
pulse width (PW). The receivers used for parameter measure- 
ments and operator skill differences produced errors great 
enough to mask subtle differences between individual radars 
of a type, and often veiled even type identification. The 
process was of course largely manual, and speed was a func- 
tion of operator skill and knowledge. And finally, since 
the data base was compiled mostly from the above observa- 
tions, the parameter value estimators were not always 
reliable. 

Studies by Stanford Research Institute (SRI) among 
others, in the early 1960's were influenced by the require- 
ment for greater speed and accuracy and stimulated by ad- 
vances in computer technology. Advancements in radar such 
as frequency agility and intra-pulse modulation dictated 
that measurements of the emitter scan characteristics and 
modulation type be added to the traditional parameters, RF, 
PRF, and PW. The emphasis however remained on type 


classification. 
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Signal fingerprinting with precision measurement of 
traditional parameters as the basis as well as some inves- 
tigation into classification by pulse shape began in the 
late 1960's. Bennett [1], [2] has explored a number of 
linear and nonlinear representations of pulse type signals 
on the basic investigative level. More recent work, as 
yet unpublished, addresses this problem in an applied 
Manner using linear bases as does the research reported 


on here. ; 


B. SCOPE OF THE THESIS 

The introduction of various fast discrete transform 
algorithms and the versatile minicomputer has opened new 
areas in the realm of signal processing and pattern recog- 
nition. Although much work has been done on the application 
of fast transforms, most if it has been in the areas of 
image processing and two-dimensional character recognition 
Stabs C4]. However, Bennett [1] included two of the three 
linear bases, and their fast algorithms, (Fourier and Walsh) 
considered in this research in his work on pulse represen- 
tation comparison. 

The intention of the work reported here is to investi- 
gate four orthonormal bases with Lt Woe to their suitability 
in signal source classification using standard pattern recog- 
nition techniques. The discrete transforms selected are 
three of the class possessing fast algorithms, namely, fast 
Fourier transofrm (FFT), fast Walsh transform (FWT), and 


fast Haar transform (FHT). 
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1. Signal Synthesis and Data Base Collection 


In order to reduce the number of variables affecting 
a signal from a set of sources, a data set is synthesized 
rather than received from actual radars. The result is 
a set of 79 radar-like pulse trains of high stability and 
repeatability. Conversion from continuous to discrete form 
was performed in the laboratory under controlled conditions 
‘so that the only noise present in the data base is due to 
quantization error. 

The pulse synthesizer is modeled after the switched, 
open-line type of pulse forming network found in some early 
radars. An artificial (lumped element LC) transmission line 
tapped at each of its 13 section junctions is alternately 
charged and short circuited by a pulser circuit triggered 
by a conventional laboratory pulse generator. Fig. 1 con- 
tains a schematic diagram of the pulser. By jumpering the 
section taps two at a time the 79 pulse types were generated. 

A large number of pulses of each type (or class) 
were converted from continuous form to discrete sample values. 
A wide bandwidth (10 MHz) analog-to-digital (A/D) converter 
reduced each pulse to a 128 sample, 8-bits per sample repre- 
sentation. The digitized pulse data was then recorded on 
magnetic tape as the permanent record. 

2. Experimental Equipment 

All analysis work was performed on the prototype 

AN/UYQ-9(XN-1) or Parameter Encoder, a general purpose signal 


analysis computer system composed of a teleprinter, card 
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reader, graphics terminal, magnetic tape drive, and 1000K 
word disc file, as well as special purpose A/D and signal 
processing devices, interfacing with a mini-computer. 

Software. for this work was specially written for 
the purpose in Basic Fortran. Included are programs and 
subroutines to convert (transform) the data on magnetic 
tape to four 64-dimensional representations, namely, signal 
or block pulse basis, Fourier, Walsh, and Haar function bases 
in their discrete forms, and analysis programs which measure 
the classificatory value of these representations. 

Results of the analysis are presented graphically 
on the terminal cathode ray tube where they are either photo- 
graphed or processed by a special hard copy unit, or printed 
by teletypewriter. 

3. Theoretic Basis for the Thesis 

The question to which an answer is sought in this 
research is whether any of the rotations defined by the fast 
Fourier, Walsh, and Haar transforms are useful in a dimen- 
sionality reduction sense for the signal data set as pre- 
scribed, and is further investigation on more general signal 
sets and possible application warranted? 

The choice of bases is a good mix of properties. 
Both the Fourier and Walsh bases are global in nature, that 
is, each coefficient is a function of all coefficients (sam- 
ples) in the signal. The Walsh and Haar bases are closely 
related in general shape and by their generating process, 


while the Haar and signal or block pulse bases have the 
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common property of being local in nature, that is their 
functions are nonzero only on a portion of the signal (time) 
axis. 

If it is found that a certain transformation is 
able to represent the distinctive features of the entire 
category of signals with relatively few coefficients, then 
that transform will probably lend itself to an efficient 
classification process. 

To this end the signal data is projected onto the 
three BS eChonoemall bases and analyzed for classificatory 
information content and distribution. The methods and 
measures used are discussed in the context of this research 
and application. 

Although this work stops at feature selection, the 
only completely valid test for comparison of one set of 
classification features with another is performance under 
a specified classification rule. Specifying the rule which 
best fits the problem at hand is itself sufficient to be 
the topic of a thesis, and is not considered here. The 
literature contains both general and specialized studies on 
the subject of classification. 

Two feature selection metrics based on second order 
statistics are developed and applied to the data. Measures 
of a potentially more powerful nature such as those founded 
in information theory are not considered because of the 


requirement for knowledge of the distributions involved. 
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A brief discussion of rank order as a feature set is 
included and could also be the subject of additional work. 
The use of a ranked vector of feature indices may remove 
some of the detrimental effects of time reference shift on 
Walsh and Haar transforms as well as reduce the information 
to be processed by quantizing the feature space. 

4, Results and Conclusions 

The signal data base was discovered to contain 
Significant jitter or variation in the time position of the 
sampling window. The extent and effect of this jitter was 
not discovered until analysis of the results had begun. Due 
to time limitation, no attempt was made to reconstruct and 
reprocess the data. 

It is concluded that, in the presence of time jitter, 
the Fourier basis can result in significant dimensionality 
reduction, and that the Walsh and Haar bases offer little 
if any improvement over the signal samples themselves. 
However, in the absence of jitter an improvement in perfor- 
mance of the Walsh and Haar bases is expected. Considering 
the speed advantage of the FHT over the FWT and the FWT 
over the FFT, some SenipROnilee to optimality might be indicated 


for real time processing. 
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II. EXPERIMENTAL PROCEDURE 


A. DATA BASE 

Early attempts at the construction of a satisfactory 
data base were oriented toward reception and digitizing 
of local radars. This approach, though esthetically satis- 
fying, proved impractical for this work. The data base had 
ea meet several criteria which ruled out the use of "live" 
Signals. First, the objective is to determine the feasibil- 
ity of fast transform method as generators of high quality 
classification features, and not to evaluate or specify a 
complete intercept system for the task. Secondly, there is 
the "completeness" problem, which is the requirement for the 
data base to span the range of pulse shapes expected to be 
encountered. The limited number of radars in the local area 
limits the completeness of the data. The alternative se- 
lected is to employ a pulse synthesizer consisting of a 
triggered silicon controlled rectifier (SCR) switch driving 
an open type artificial transmission line pulse forming 
network similar to those used in early radars [5]. Modern 
pulse formers are more likely to employ saturable inductances 
in a high level modulator, but will still produce component 
value dependent pulse shapes characteristic to that radar. 

Figure 1 contains a schematic diagram of the line pulser 
and its connection to the line and other devices, and also 


shows the ensemble of pulse shapes which comprise the data 
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base. The artificial line, originally constructed for 
laboratory experimental use, is tapped at each end and at 
each LC section junction for a total of 15 taps. The line 
characteristics and hence the pulse shape are altered by 
jJumpering or short circuiting various taps, creating branches 
and shortening the length of the main line as shown in 


Figure 2. 





Figure 2. Line Configuration for Class 2-7 


In forming the pulse ensemble, 13 taps, number 1 to 13, were 
exhaustively jumpered two-at-a-time for cS = 78 distinct 
line perturbations which with the "no jumper" or 1-1 config- 
uration yielded 79 distinct pulse shapes. Referring to 
Figure 1, note that adjacent pulses are similar both row 
and column wise, differing mainly in the position and shape 
of the perturbation. Although they may not accurately 
represent any given radar's emitted pulse shape, they do 


span a considerable number of possible shapes for pulses 
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of similar duration, and are considered a good base for 
comparison purposes. 

The electrical length of the line is 9 microseconds 
giving a maximum pulse length of 18 microseconds. Observa- 
tion of all pulse spectra showed that spectral components 
above 900 KHz are at least 50 db below the largest component. 
Based on this and a requirement for complete framing of the 
pulse in a 64-sample window, a sample rate of 3.0 MHz was 
chosen for digitizing. 

Digitizing is the process of converting the continuous 
voltage waveform output of the line pulser to equally spaced 
voltage samples converted to 8-bit (256 level quantization) 
binary numbers or words, and the recording of these samples 
on magnetic tape. The maximum rate of the A/D converter is 
10 MHz, placing the rate used well within device limitations. 
Each pulse digitization consists of 128 samples, and a total 
of 4096 pulses for each of two "identical" lines in each of 
the 79 configurations were committed to magnetic tape, and 
these make up the permanent data base. 

The final step in conditioning the data for analysis is 
framing of the pulses in windows of 64 samples each. The 
first sample or the beginning of the window should correspond 
to a constant amplitude point on the leading edge of the 
pulse, simulating a threshold crossing triggered sampler. 
This step is performed manually by placing the joy-stick 
controlled cursor of the graphics terminal on the desired 


point of the leading edge of a displayed pulse and commanding 
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a "store" operation. The algorithm finds and stores the 64 
samples following the cursor position in a file on the sys- 
tem's disc. Figure 3. illustrates the flow and form of the 
data during the data base building process. 

It is this last step with its human interaction, and 
the unsynchronized nature of the digitizing process which 
are the causes of the window time jitter and the consequently 


poor data from the non-time-invariant FWI and FHT. 






LINE oF | 
PULSER " A 
CONTINUOUS 8-BIT INTEGERS PER PULSE {6-BIT INT. PER PULSE 





Figure 3. Data Flow and Form During Data Base 
Construction 


B. DATA PROCESSING 

The sequency of operations on the signal data base are 
experimental in nature and are not designed for production 
type processing although some of the SURO LAeS COLE be 


readily adapted for use in an operational program. 
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Programs written for the Parameter Encoder for this 
research are listed below with a description of their 
functions. 

1. Program TRED 

a. Function 
TRED prescreens and transfers the digitized data 
from magnetic tape to disc file. 
b. Description 
TRED reads the 128 samples per pulse data from 
a specified file and record on the magnetic tape, and 
displays sequentially and individually in graph form on the 
terminal CRT those pulses which exceed a preset threshold 
Volulce lie tnersrenade 1S noisy.) tLhateiis, contains parity, 
errors or is not of the desired type due to an error in 
jJumpering the pulsed line, it can be rejected. If the data 
is suitable for further processing, the operator places the 
cursor crosshairs at the leading edge of the pulse. The 64 
samples following the leading edge are stored on the disk 
as 64 16-bit integers. The program may be terminated at any 
time. 
2.) Eroeramn Slit 
a. Function 
SLFT calls those signals stored by TRED and 
performs 1, 2, or 3 fast transformations on the data. The 
transform coefficients are then stored along with the signal 


data in a separate class structure file on the disc. 
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b. Description 
SIFT can optionally perform a second screening 
of the data enabling cursor positioning errors to be detected, 
or it may automatically and sequentially process any signal 
data located in TRED's file. The three transformation which 
can be performed are subroutines and are easily changed. 
All transform coefficients are normalized tto the average 
value (zero-th order coefficient) and then stored as 64 
floating point numbers in a disc file location in space set 
aside for that particular pulse type or class. eeeites of 
the fast transform subroutines are provided in Appendix C. 
Sho Program MEVAR 
a. Function 
MEVAR calculates the class meam and variance. 
b. Description 
MEVAR uses the transform data stored by program 
Sinn to Calculate) the mean values of, each coefficient of each 
transform for the signal type or class specified. The means 
are stored and then used to calculate the wariance or second 
central moment of each coefficient and tramsform. These 
class data are stored in a third disc file. 
4, Program GVAR 
a. Function 
GVAR is a feature selector program calculating a 
measure of feature goodness based on the average fluctuation 


of class mean values weighted inversely to class variation. 
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b. Description 
GVAR uses the class data of program MEVAR to 
calculate a global central second moment from weighted class 
data. The results are presented in original coefficient and 
also in ranked order. 
5. Program FRAT 
a. Function 
FRAT is a feature selector program similar to 
GVAR. The measure of goodness it employs includes a weight 
which is a function of the number of members in each class. 
The results can be interpreted as a kind of signal to noise 
ratio where the signal is classificatory information and 
noise is the average within class variance of the signal 
transform coefficients for each dimension. 
b. Description 
FRAT uses the class average data of program 
MEVAR as does GVAR. The results are presented in original 


coefficient order and in rank order. 


25 











of islioia mergetq totoeled Siidest se 2 TARY 
digtew @ ssbulont cyolfqne #1 enenBoog To s1vesem 
+aeelo dose at aredsem to tedmud af? 16 nolttoaut & 
dston oF [angie Yo bul¥ © ex beseigrevnt «4 uss & 
bag nolvamtotal motecttieasls af fengte sdt 
[angie sid 20 sonstray geals ofdéltw eget ova ond 
nolanemtb Asze 26% Sinatottre00 

Adtiqtusasd 

Me raorG Io aieh agetevs éa6fo O42 eoav TART 
sinkgiwve ol G6stncnetg ota etigest eT HAVO cach & 


36010 Wena al Bae tsbic Jaosk 


IIIT. SIGNAL TO TRANSFORM SPACE -— PROJECTION 


A. TRANSFORMATIONS AND CLASSIFICATION 

At this point the terminology and notation employed for 
the remainder of the thesis will be standardized and oriented 
toward linear vector spaces and the classification problem 
rather than to anietcal eoncente. 

The question "why transform?" may be asked with some 
validity. Any operation on a signal requires time and 
expense. The answer, fundamental to the field of pattern 
recognition, is reduction of dimensionality. A complete 
description of any possible signal representable in a space 
of dimension N requires all N dimensions. For signals 
emitted by a specific source, the N-dimensional representa- 
tions will be similar and will differ in some manner from 
representations of signals from another source. The problem 
of classification is how to measure this difference so that 
classification errors are somehow minimized. If all N dimen- 
sional projections contain significant information then all 
N must be included in the metric. However, if this signal 
space can be rotated somehow so that the information in 
some of its dimensions can be projected onto a single dimen- 
sion in another space, then the information has been com- 
pressed or dimensionality reduced. However, a rotation that 
works for one signal class probably won't work for all signal 


classes in the category of signals of interest. The criteria 
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and evaluation methods for a transformation are discussed 


in Section IV. 


B. THE FAST TRANSFORMS 

The primary reason for selection of the Fourier, Walsh, 
and Haar discrete transformations is the existence of fast 
algorithms based on elimination of redundancy [3], [4], by 
matrix factorization of the basis matrix. An N-dimensional 
peenarormac ion in general requires ne real or complex multi- 
plications. A FFT or FWT requires but Nlog.N arithmetic 
operations (complex multiplications for the FFT and real 
additions for the FWT). A FHT because of its highly local 
nature (lots of zeros.in the transform matrix), requires 
only 2(N-1) real additions and N-2 normalizing multiplications. 

Another important reason for the selection of discrete 
Fourier, Walsh and Haar transforms is the difference in the 
basis functions of the transformations. Appendix B addresses 
the Walsh/Hadamard and Haar functions in greater detail. 

The Fourier and Walsh functions possess similarities such 
as the average number of sign changes per unit interval and 
even/odd symmetry which lead to the terms sequency, sal, 
and cal for the Walsh functions. Furthermore, the Walsh 
and Haar functions are closely related. 

A final comment on the translational invariance is in 
order. The Fourier basis representation is invariant under 
time translation while the Walsh basis is invariant under 
dyadic translation. That is, the Fourier magnitude coeffi- 


clents do not change when the signal data samples are 
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cyclically translated, that is, 
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where ® indicates modulo(N) addition. This is equivalent 

to sliding the signal in the reference frame. Walsh coeffi- 
eients do change under this type of translation but are 
invariant when signal data are translated or reorder according 
to the mod(2) bit-by-bit sum of the origimal index and the 
translation constant, k. 


SaaS Ss mS OES ) 


Sos WOO? Teo cL" 


2 = §S(_. oooex)? 5¢...001ex)? °°°? 8(1...110x)? 


where ® now indicates modulo(2) bit-by-bit addition and k is 
an integer expressed in binary form. For this application, 
dyadic invariance is not beneficial, but if time translation 
is minimized this drawback is not serious. The Haar transform 
is also not time invariant. 

Figures 4, 5, 6, and 7 are plots of the 64 dimensional 
representations of the data for the 79 pulse classes 1-2, 
30 ot eee dle PA 38)) Reterring to Rigure 1, 
the class sequence progresses up the columns moving from 
left to right. The spaces are signal, Fourier (magnitude), 


Walsh, and Haar in Figs. 4, 5, 6, and 7 respectively. 
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Figure 4. 3-Axis Plot of Prototype Signals of the 79 Classes 
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IV. DIMENSIONALITY REDUCTION - FEATURE SELECTION 


A. PURPOSE 

A main principle in pattern recognition is the elimina- 
tion of redundancy and useless information in the given data 
so that the classifying algorithm can make efficient use of 
both time and machines. This elimination process is dimen- 
-sionality reduction, and the process itself is commonly 


termed feature selection [3], [4], [7]-[9]. 


B. FEATURE SELECTION 

The projection of an N-—dimensional signal vector repre- 
senting an N-sampled time function from the signal space 
to a transform space by means of a complete orthonormal 
transformation does not in any way inherently reduce the 
dimensionality of the representation. However, a transfor- 
mation of this type can be viewed as measuring the correla- 
tion between the signal and each of the N basis functions. 
Hence it seems reasonable to assume that, given a certain 
category of signals, certain orthonormal transformations are 
more efficient than others in the sense of requiring fewer 
coefficients to attain whatever the objective may be. 

If the objective happens to be representation of the 
signal in more compact form, then perhaps all transform 
coefficients smaller than some threshold value could be 
eliminated, resulting in a reduction from N to, say, K 


dimensions. Then the representation obtained from the 
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inverse transformation back into the signal space is the 
best Si approximator of the original signal in terms of 
that orthonormal basis. See Appendix A. The "closeness" 
of this approximate representation is commonly measured in 
terms of mean square (or energy) error (MSE), which in vector 
space context is the squared Euclidean distance. This error 
is given by 
a Nae ~ 2 
MSE=F 2 (s(nT) - s(nT)) 
; n=0 
where: s(iT) are the original signal samples 


s(iT) are the signal approximator "samples" 


T is the sample interval. 


For the purpose of classification of signals the elimina- 

tion criteria are different, and the MSE of the before and 
after representations is not necessarily a good measure. 
Some of the most distinctive characteristics of a signal may 
contain very little energy. Their elimination causes little 
energy error but a large loss of classificatory information 
in the reduced representation. 

Consider the signals s, (nT), A= ROM ME eo elas 5, NaI, 

a 2 La2oooo gd Oiealesboengalayes strc WG Jl RORIACS CLASSES Ewlal wise 
the category of interest (pulsed signals from different 
sources of the same type). The N-dimensional vectors formed 
by the signal samples define I points in the transform 


space which will tend in some manner to form M clusters 
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representing the M source classes. For a given orthonormal 
transformation sine points will project onto each of the 

N basis vectors and clustering to some extent will occur in 
each dimension. The dimensional cluster for, say, class m4 
will exhibit some spreading which is related to the manner 
in which signal perturbations and system noise project onto 
that particular basis vector. Another class, Ms will 
similarly cluster on that dimension with some spreading. 
The difference between the cluster mean values is a measure 
of that dimension's classificatory information, the use of 
which in classification is degenerated by the intra-class 


spreading. 





Figure 8. Hypothetical 2-Class Projection 
onto 3 Orthogonal Axes. 


Figure 8 is a 3-dimensional, 2-class hypothetical example. 


The projections of both classes m4 and m, on basis axes ty 


and t, exhibit small spreading, however the cluster separa- 


s 


bility on axis t. is clearly greater than on axis Bae The 
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projections onto axis to are widely spread and even though 
the mean values differ considerably, no separability exists. 

This illustration suggests a class of feature selection 
metrics based on the concept of signal (information) to 
noise ratio. The two feature selection metrics investigated 
in this thesis are both of this type. The first is simple 
and intuitive, used primarily for purposes of illustration. 
-This metric is incorporated in Program GVAR and can be 


expressed as 


a ae 
G = -—— 2. 
n M-1 aay ge m 

n 
where: 
ou “4s the estimated n th dimensional 
mean for class m, 

U, is the estimated are dimensional 


average of class mean estimates, 


a2(m) th 


o is the estimated n dimensional 
variance for class m, and 


M is the number of classes in the 


category. 


There is no compensation for differences in cardinality of 
class populations, and it is sensitive to round-off errors 
encountered when the dimensional projection means and the 
variances are nearly equal and very small as would occur 


if the basis vector for that dimension were orthogonal to 
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everything in the signal vector. This instance occurred 
in the case of the Haar basis, some functions of which are 
non-zero only in regions where the signal is either zero 
or a constant. 

This test is simply the average of the ratios of squared 
class mean deviations from the global average to class 
variance. Because of the sensitivity to computational 
errors, the results may be misleading. It does lead natu- 
rally to a more powerful and less sensitive variance ratio 
test incorporated in Program FRAT. 

This latter test is a modified form of the Snedecor 
F test so called for Fisher on whose Z distribution the test 
is based [10]. Snedecor's F test as used here provides, 
in addition to a relative goodness number, a confidence 
percentage that the variance among class mean values is not 
due to the average intra-class variance (or noise). How- 
ever, it is modified slightly to reflect the relative 


probabilities of occurrence of a class. The metric F is 


given by 
M 
1 a(m) ANE 
M-1 Z Paty ie uy) 
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where: 

Pp is the relative probability of occurance 
of class m (more properly that an observed 
signal came from source class m), and 

Kh is the number of signals in class m. 

A comparison of the results of the G@ test and the F 
ratio test indicate that the latter is not as sensitive to 
data and computational problems. 

Signal-to-noise or variance ratio type tests are not 
the only metrics for feature selection. Several information 
theoretic approaches have been applied to multiclass classi- 
fication [7], [8]. There are other, perhaps more elegant 
methods, applicable to the two class problem or the clustering 
problem [9]. 

From the feature selector algorithm results a subset 
of coefficients is chosen which can be tested further for 
optimality. Of course the only valid test is minimization 
of classification error, a test not performed here because 


of time limitations. 


C. COVARIANCE AND CORRELATION 
While feature selection tests will in general measure 
the classificatory information a feature (or dimensional 
projection) contains, they are not sensitive to the kind of 
information but rather only to the average net accumulation. 
If the pulse signal classes of concern have hypothetical 


linearly independent details, say A, B, C, and D, which occur 
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in various linear combinations to characterize the classes, 
then the optimal linear orthogonal transformation which can 
ine performed on the signal data is the one which is able to 
project each detail onto its own dimensions. Restated, let 
the basis vectors of the transformation be generated from 
the signal details so that the projections in the transform 
space are mutually uncorrelated. Sebestyen [9] proves that 
this transformation (followed by a diagonal feature weighting 
transformation) is the optimum linear transformation for 
feature generation. This transformation is variously called 
Holelling's Method of Principal Components, Karhunen Loeve 
Transform, and factor analysis. The matrix defining the 
transformation is the matrix Yo of the signal set. 

ay 


Pay pe=Mdiae (ie, A ene) 


where the As are the eigenvalues of 2 and 


S? 


P is the matrix of eigenvectors corresponding to the 
eigenvalues, Ay: 

While this. transformation would appear to be the solution 
to the problem, there are aspects of pulse source classifi- 
cation which nullify its attributes. Most important is the 
fact that it is a complete orthogonal transformation only 


for the signal from which it was generated. New features 
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of new signal source classes will be undetected unless 

they contain a linear combination of one or more of the 
transform basis vectors. Secondly, since the basis is data 
dependent and not composed of a fixed set of orthonormal 
vectors, no factorization and hence no fast algorithms 

are possible. This means that the transformation will 
require n° real multiplication operations and that unless 
the feature space can be greatly reduced, an application 
where speed is important cannot use it. 

The covariance matrix Ym is calculated for the reduced 
feature sets derived from the three fast transforms inves-— 
tigated. These are presented in the next section in nor- 
malized form as correlation matrices. Ideally, feature 
vectors of all Signals*injall classes, i.e., all observa— 
tions, should be used in the calculation of a global corre- 
lation matrix; however, due to machine limitations, only 
the class mean feature values were used since they are the 
best statistical estimate of actual feature values. The 


covariance matrix is then: 


a(m)4T ~(m) 
yp = OU Iya Yn In 


bong? iy Phd 


where i,j range over 1, 2, ..., N independently and k,2 


range over 1, 2, ..., M independently. 
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The correlation matrix is obtained by normalizing all 
elements to the inverse square roots of the diagonal 


elements which are the global variances of the class means. 


where i, jJ, k, 2, are as defined above. 


Off diagonal elements C reflect the degree of 


ij 
correlation between features of index i and j. 
D. RANK ORDERING 

To this point only continuous measures in continuous 
vector spaces have been considered. It is possible that a 
discrete space might be entirely suitable if not superior 
when the inter-class distances and intra-class variances 
under a discrete metric are such that a quantized space 
does not increase classification error. 

Consider the case of ordering the features, selected 
for their information content and derived from a complete 
orthonormal transformation of the signal space as above, in 
decreasing value order. If the reordered feature indices 
rather than the feature values are used for classification, 
the information rate between the signal processing device 
and the classifier could be reduced considerably. The 
classifier itself could possibly be simplified. 

Using the data of this thesis for example, data samples 


are 8-bit integers and the projections in the transform 
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space are floating point numbers requiring 32-bits. If the 
number of features used for classification is 16, then, for 
each pulse observation 512 bits must be sent to and processed 
by the classifier. Now if only the rank orders is preserved, 
the 16 features are represented as 4-bit integers and each 
pulse observation results in transmission and processing of 
64-bits. For a given channel bandwidth, significantly more 
information could be sent per unit of time if a suitable 
classifer can be found. : 

The feature space becomes quantized with N! = N(N-1)(N-2) 
---(2)(1) distinct points corresponding to all different 
possible orderings of N features. For the case N = 16 there 
are more than 2 x 1033 distinct points. The 3-feature space 


is illustrated below. 





(AD) 2 3 


Figure 9. 3-Space Representation of all Rank 
Ordered 3-Vectors (I, 15,13) 


42 











“s ( 2 hn, 
= ine. +t vethdese ante pes seine _anktsoll « 
| - - Tor ,Aadt et at sotauatnants 10% bat : arise a tn) 
 heaeonorg bas 02 tase. od Faua atid, SE@. mc s 

‘ciara boas Gat ad aa 
: Hose bne ategsial sid-i sntelanaitieal ‘ rus : 
Yo gniessco7g bas ndteelmenesd at ativest got avrsede 
siom ylinsotitngts «d¢biwbnad Lennada nevis a ao 

efdetive a 2 emtd Yo shaw teh dnee sa Sivoo Hall 

-bayort od 7 

(Sa) (1-H) = tif atte bextinasip ssmoosd sqaqu sivtset 
tnetettlb Ife of gatdbnogesrrds etntog sontdal >t 
 ereds 12 « Uses od coh .cousiesl U So apnles adil 
 $0q8 stutest-E of? .efateq sontreth “or x | 





















aH iin Io colisynseewqst sosgdeE’  .¢ enugk® 
(oiiols,1) etotos¥-—¢ borsiat 


X “ » 


There are tests which can be applied to ranked sets 
which could find application to this problem. Moroney [10] 
discusses several in the context of evaluating judges asked 
to rank things in order of quality. A test which evaluates 
the degree of agreement within a group of rankings (a class 
cluster) compares the mean squared difference of perfect 
agreement ranking and the expected ranking. The expected 
‘ranking is the average of all possible rankings and is indeed 
not a ranking at all, but an N-vector with all entries equal 
to N(N+1)/2. The result is a number between 0 and 1 called 
the Coefficient of Concordance by Moroney. This test 
might find use as a feature evaluator since it provides a 
measure of intra-class fluctuation. 

Another test measures the correlation between two 
rankings and yields a number, R, between -l and +l given 


by the empirical appearing formula 


N 

Ge ae 
ms n=1 
R=l- = 

N(N > - 1) 


where dn is the difference between ranked indices. R is 
called Spearman's Rank Correlation Coefficient and might 
be employed in classification, measuring the correlation 
between an unknown ranking and the mean ranking of classes 
taken one-at—a-time. 

Rank ordering was not considered in this investigation, 


but it appears to warrant further study. 
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V. DISCUSSION OF RESULTS AND CONCLUSIONS 


The intention of this research is to explore the feasi- 
bility for generating classification features for pulsed 
Signals by linear transformation using so-called fast algo- 
rithms. The underlying premise is that the pulse generation 
‘mechanisms of distinct sources impart sufficient information 
to the pulse (envelope) shape to allow classification on 
this basis. A complete orthonormal transformation process 
cannot create information, and, by the completeness property, 
does not destroy it. The hypothesis is that such a trans- 
formation will result in a more efficient distribution of 
classificatory information than is inherent in the signal. 
Restated, the pulse shape representation in signal space 
requires consideration of more dimensions for a specified 
classification confidence level than does some transform 
space defined by a fast discrete method. 

In Section IV it was stated that the Karhunen-Loeve 
transform is optimal for a closed, invariant set of features, 
and results in the least dimensionality for a specified 
error tolerance under a MSE metric. It does not, however, 
meet the fast algorithm requirement. Thus it is sought to 
determine if the FFT, FWT, or FHT results in a compacting of 
classificatory information significant enough to warrant 
further investigation and possibly application. 

The discrete representation results in a dimensionality 


of 64 for the signal space and each of the transform spaces. 
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Using the second order statistics of the 79 signal classes, 
and treating the projection onto each dimension as a classi- 
fication feature, two measures of information content were 
applied to each of the transform spaces. The F Ratio metric 
was then applied to a subset of 20 signal classes to provide 
a comparison between the three transform spaces and the 
signal space to substantiate the hypothesis that a trans- 
formation (or rotation of the space) can result in a more 


compact representation for classification purposes. 


A. INTERPRETATION OF DATA 

A complete listing of numeric data is presented in 
Appendix D. 

A comparison of the transform class prototypes, that is, 
the class estimated centroid in N-space, is shown graphically 
lie ures 0) ll es anduls horwssenal, Mourler, Walsh, 
and Haar representations. These figures consist of 79 
superimposed curves consisting of lines connecting data 
points which are signal samples for Fig. 10 and transform 
coefficients for Figs. ll to 13. The data are scaled 
differently for illustration purposes. 

The collection of points of intersection of the over- 
laid curves and a line drawn vertically from any index 
point, n, gives one an indication of the distribution of 


ae on the nue dimension. 


the class mean values, 
Figures 14, 15, and 16 are graphs illustrating the 
measure of classificatory information and its distribution. 


The horizontal axis is calibrated by index of decreasing 
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Figure 11. Overlaid Plots of the Fourier Prototypes of 
79 Classes 
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Figure 12. Overlaid Plots of the Walsh Prototypes of 
79 Classes 
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rank of magnitude in test results, not in original coefficient 
index order. Tables Dl to D10 of Appendix D list the 
numerical values in both original coefficient and rank order. 
1. Comments on Signal Data 

Before a meaningful comparison of any data can be 
made it must be normalized or scaled to some reference. 
In the case of the transform coefficients, this reference 
is the zero-th order coefficient or average value of the 
signal. The same reference is used in the feature selection 
tests. In Peure 10, each curve is scaled to have the same 
maximum value which may be misleading. 

The superimposed curves show that there is consider- 
able error in estimating the leading edge of the pulses 
from which the prototypes are estimated. By linearly 
extrapolating the estimated actual pulse origin, it is 
apparent that an error on the order of 8% of the average 
pulse width is present. That it appears in the class proto- 
type indicates an inconsistency in the leading edge deter- 
mination process which is manual. A threshold crossing 
decision would have minimized this error which undoubtedly 
affected the Walsh and Haar data due to the non-time-invari- 
ant nature of these transformations. 

- To illustrate the relative effects of time window 
jitter and quantizer noise, a pulse class (9-11) was selected 
at random for inspection of each signal and transform used 
to generate the class prototype. Figures 17 - 20 show the 


signal, Fourier, Walsh, and Haar coefficients of the class 
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as superimposed curves. In Figure 14 both time jitter and 
quantizing effects are apparent. The FFT data, Figure 18, 
shows no visible coefficient variation, while FWT and FHT 
data, Figures 19 and 20 respectively, show that some coeffi- 
cients are quite noisy. The Haar functions of index pih 
m=l1, 2, ..-, 5, are non-zero only during the first 6472™ 
signal samples and thus reflect the effect of time jitter 
to the greatest extent in their respective coefficients. 
Results of the F-Ratio test performed on the signal 
sample data for the 20 classes 6-11 through 10-12 ses 
Fig. 16) indicate that most of the information of classifi- 
eation value — as aeverninve by this metric — is distributed 
fairly uniformly over 32 of the 64 samples. Figure 21 shows 
how the information for these classes is distributed in 
signal space (time) order. This is somewhat surprising in 
that the leading edge region is considered by this metric to 
be useless while the latter midsection and trailing edge 
region rates high. This result is believed due to the large 
variance in edge data caused by the time jitter mentioned 
above. The trailing edges are affected on an individual 
class basis rather than globally, which does not tend to 
lower the average for the whole ensemble. Given an accurate 
time-of-arrival (TOA) estimate it is conjectured that the 
leading edge region would rank high also. This would tend 
to increase the necessary dimensionality by including more 


samples in the "good feature" category. 
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2. Comments on Transform Data 

Because of the magnitude operation on the Fourier 
sine and cosine pairs, the number of unique coefficients is 
reduced by half. This operation is time consuming but 
results in time-invariant features which, in light of the 
. Jitter present in the data base, would tend to favor the FFT 
in this comparison. Not so fortunate are the Walsh and Haar 
bases, both of which are affected by time reference variation. 
Figures 14 and 15 compare the information distributions in 
the three spaces while Figure 16 includes signal data as well. 

From Figures 14 and 15 it is apparent that the Fourier 
basis has several clear advantages. Most of the useful 
information is in the first 12 coefficients. Not only is the 
information concentrated in a few features, but that infor- 
mation is a monotone decreasing function of index. Thus 
the order of the transform, N, and the time of execution can 
be reduced considerably. For an order reduction R, which is 
a power of 2. the number of arithmetic operations is reduced 
by R log5R. For the case considered here the savings in 
arithmetic operations amounts to a reduction factor of 8. 

The FWT and FHT data are difficult to interpret due 
to the time jitter. All Walsh coefficients are global in 
that they are functions of all signal data points, whereas 
all Haar coefficients except the first and second are local. 
See Appendix B. The first two Haar functions are identical 
to the first two sequency order Walsh funetions and hence 


will generate identical coefficients. 
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Time jitter may have two effects on the FWT coeffi- 
cients. It will certainly produce a variation in coefficient 
values which would reduce their effectiveness as classifica- 
tion features. Furthermore, in the case of higher order 
coefficients, this variation might tend to make the cluster- 
ing multimodal. The variance ratio feature selection tests 
used in this work fail when clusters are not unimodal. This 
may explain why so many of the Walsh coefficients have large 
apparent information content. 

The similarity of Haar functions to both Walsh 
functions and so-called block pulses (which are the set of 
basis functions for the signal space) is apparent in Figure 
16. The Haar coefficient curve is similar to the Walsh 
coefficient curve for those features of high information 
content and to the signal sample curve for those of little 
apparent information. 

Condensed correlation matrices for the three trans- 
form spaces are shown in Tables Dll to D13. Only the eight 
features having the highest classificatory information as 
determined by the 79 class F-Ratio test are included. 
Evident is a high degree of correlation between FWT and FHT 
coefficients which may be due to multimodal clustering or to 
poor resolution of a given signal detail by anything but an 
extended linear combination of Walsh or Haar basis functions. 
In this respect the Fourier basis also excels as evidenced 
by much smaller, but still considerable, inter-coefficient 
correlation. Once again, this may be due to the time 


invariance of the Fourier basis. 
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B. CONCLUSIONS 

On the basis of the results of this investigation it is 
concluded that the Fourier basis as represented by the FFT 
can produce a dimensionality reduction factor of 5 or 6 for 
the signal data base employed. If actual pulse signal 
emitters of a common type display this degree of pulse shape 
dissimilarity ‘einer efficient classification should be 
possible on the basis of signal envelope shape. The effects 
of additive noise, multipath propagation, and signal distor- 
tion resulting from pulse-to-pulse amplitude pamdatsion and 
a nonlinear (square-law) detector were not investigated and 
would certainly degrade the value of the selected features 
for classification purpose. 

No positive conclusions can be drawn from the Walsh and 
Haar transform results due to the jitter present in the sig- 
nal data base. Further investigation may show that in the 
absence of time window jitter one of these transforms may 
exhibit the capability for dimensionality peduetton to an 
extent that its use as a feature generator is feasible. 

The fact that the FWT and FHT are extremely fast makes them 


highly desirable for real-time processing. 
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Figure 14. 
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F-Ratio Test Information Measure of 
Representations in Three Bases for all 
79 Classes as Functions of Test Rank Index 
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Representations in Three Bases for all 
79 Classes as Functions of Test Rank Index 
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Figure 16. F-Ratio Test Information Measure of Four Basis 
Representations for 20 Classes (6-11 to 10-12) 
as Functions of Test Rank Index 
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Figure 17. Overlaid Plots of the 25 Signals Defining 
Class 9-11 


58 


edy 


Be 


i 


o stol4 Bblalsevo 
Iie-@ easld 








tts 





16 32 16 0 


MAGNITUDE COEFFICIENT INDEX 


Figure 18. Overlay of the 25 Sets of FFT Coefficients 
of the Signals Defining Class 9-11 
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Figure 19. Overlay of the 25 Sets of FWT Coefficients 
of the Signals Defining Class 9-11 
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Figure 20. 


COEF FICIENT INDEX 


Overlay of the 25 Sets of FHT Coefficients 
of the Signals Defining Class 9-11 
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Figure 21. F-Ratio Test Information Measure of Signal 
Samples for 20 Classes (6-11 to 10-12) as a 
Function of Sample Index 
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APPENDIX A 
LISTING OF FAST SUBROUTINES 


201. FIN 
go02 SUBROUTINE FFT(M,REAL,SIGNF) 

9203 DIMENSION S(2,64),RIM(64) ,REAL(64) 
9004 C 

9205 C FAST FOURIER TRANSFORM 

g006 C : M - LOG2(NOMBER OF SAMPLES) 
g007 C REAL - I/O ARRAY 

goog C SIGNF - DIRECTION OF TRANSFORM 
g209.C OUT PUT IS IN MAGNITUDE SQUARED FORM 
go10 C 

B11 N= 2keM 

g012 NHALF = N/ 2 

9B13 FLOTN = N 

Q014 PIARG = 6.2831853 / FLOTN * SIGNF 
@015 DO 1900 I=1,N 

@216 1008 RIMCI) = B 

0017 DO 3000 I=1,M 

9018 N21 = 2kk(M-I) 

@219 NI = 2&k(I-1) 

9026 DO 2008 J=1,NI 

2221 IN2I = (J-1) * N2I 

9022 THETA = FLOATCIN21) * PIARG 

0223 C = COS(THETA) 

0224 SI = SINCTHETA) 

g225 DO 2008 K=1,N2I 

2226 -IN@ = K + IN2I 

@027 IN] = K + 2*IN2I 

g228 IN2 = INL + N21 

9229 IN3 = INO + NHALF 

@030 C COMPLEX MULTIPLY 

9231 CR = C * REAL(IN2) - SI * RIMCIN2) 
9232 Cl = SI * REAL(IN2) + C * RIMCIN2) 
2033 SC1,IN@) = REALCINI) + CR 

9034 S(2,IN@) = RIMCINI) + CI 

9035 S(1,IN3) = REALCINI) - CR 

9036 S(2,I1N3) = RIMCINI) - CI 

0237 2820 CONTINUE 

9838 DO 3000 L=1,N 

9039 REAL(L) = SC1,L) 

2040 RIM(L) = S(2,L) 

@241 3080 CONTINUE 

g242 C COMPUTE MAGNITUDE SQUARED 
(9043 DO 4900 I=1,N 


19044 4006 REALCI) = REALCI)*REALCI) + RIMCI)*RIMCI) 
‘BB45 RETURN 
G46 END 


63 


a 


ts. 


MATT 















rer 
esurTUORaUE NEAT_FO OW 


CWO LS, JASA MITA aurTvoR 
COBYIATA, CDBIMING (AD eSIE WOLehas 


miOvSNAAT ASTAHUOT Tar 

2arwal 30 AaeMoKn ds SD0d * A 

YAMA ONT ~ JAA 

MAOTZMART WO HOTTSRRIG =~ 2heTe 
QzIRAUoS SOQUTIVOAM WE Br TUS TO 


Siv & = 
: ¥ = 
Wwat> # WIOTt \ ECBlLESS.2a = 


Ci-L) ees =4 
u, iz 9688 OG 
™ * Ci-lL?d s 1 SOB! 
SUID TAGIT => ATA 
CATSNTIZOD = 
(ATENTIMIC 2 3B 
(Su,ick BAGS OF 
[S41'+ a - 
ranies + A 
Ion + TKI 
(iA © OUT 
VISIT We AIIM 
oa 2 (Saf) JAGR © 9 =-ROE 
. 1.1) JA5h « 12 = 12 
4 ‘et per = (ONL, Fe 
» CLININ = CONT Ie 
wtp JARA ‘2 Cet ly ties 
CIMTIMNIG = CHI. S98 
WM 11 HOD: 


I 
"fata « Cis 


~ 


“nh te 


Wied 900t OG= 
ti,i3¢ 3 4 1) 1ASH 
‘i367 C.19m1k 


you JaUTIMOeN ATUANOD 


. #.t2t GAGA O¢ 
ree : M1if P ti) fASNeq 12 LA TH : {TS JASR 
- WRUTAA 

ana 


qagaad 


1022 
1520 


2008 
3000 


SUBROUTINE FWICM,X) 


DIMENSION X(1) 


N = 2**M 

NH = N/ 2 

LR = @ 

DO 1880 L=1,M™ 
Lip 8B jb se i 

LM =L-e- 1 

Ue B Ly SOR 
Ere "N = LR 

NY = O 

NZ = 2**LM 

NZI = 2 * NZ 
NZN = N / NZI 
DO 1028 I=1,NZN 
NX = NY + 1 

NY = NY + NZ 

JS = (I-1) * NZI 
JD = JS + NZI + } 
DO 1000 J=NX,NY 
dS Ss ds l 

JT = J+ NH 

LAS, 2 UR ae lS 
Lota} Ss jb se dj 
Ritdiit SS Ib se ollie 
XC(LJS) 

Dea, Dam a) 

LJD = LR + JD 
X(LJD) 


IPN 
XCI) 


RETURN 


END 


FAST WALSH XFORM 
M - LOG2(N) 
N - NUMBER OF SAMPLES 


X = I/0 ARRAY: 


SrersGloitcl). ae 2s biraley 


= XCERIS =e GE ls) 
IF € LR ) 1580,3000, 1508 
DO 20008 I=1,N 


Lats iN 
XCIPN) 
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(N+13:2N)=SCRATCH 


HOTARDS=(MSrien? sONT stad) sYARRA GAL = x 










| veered 

CLIX MOTAMSNIC 
NAOTX H2SAV TEAS 
(¥)Sd0J - K 

23/94A2 WD RIGA - A 


“~& 
* 
Ww 
" 


“ 
PSS... aes 


wn ” 


Nyi=1 6 


s 


ir 
“on 


eo oe eter ak 


oe =e tec = 


wet Kw 
cere 
a 


ih i ee 


CTLTIOK © CESAR = 4G) 
oaet ,9904,68¢C! 4 fd 


CHAEDX = [IA GU 
¥HUTSAN OB 


"i > 
cw 


x) 


9001 
ga02 


B03 
8204 


B2H5, 


BB26 
B87 
0088 
2089 
0216 
O611 
BH12 
@013 
B14 
@815 
8016 
O217 
9018 
GB19 
8822 
0221 
8B22 


~ 0823 


B224 
625 
GB26 
0827 
9828 
GE2S 
8030 
031 
G232 
0033 
8034 
9035 


FIN 


QaQaqanqgagnInananna 


10800 


22888 


3008 


4800 


SUBROUTINE FHTC(M,S) 
DIMENSION S(64),H(64) 


FAST HAAR TRANSFORM 


M - LOG2(NR OF DATA POINTS) 
S - I/0 VECTOR OF LENGTH 2**M 
H - SCRATCH VECTOR 


FHT REQUIRES 2(N-1) REAL ADD OPERATIONS 


N=2** M1 

NH=N 

DO 4006 I=1,™ 
NH=NH/2 

DO 1688 J=1,NH 
Il=J 

I12=J+NH 

J2=2x*J 

Jl=J2-1 
HCI1)5SCJ1)+SCJ2) 
HCI2)=SCJ1)-SCJ2) 
CONTINUE 

NH2= NH*2 


DO 2088 J=1,NH2 


SCJI=HCJ) 

CONTINUE 

GO TO (4680,3000)1 
NH2 1=NH2+1 

DO 4008 J=NH21,N 
S(J)=SCJ)*1.414213562 
CONTINUE 

RETURN 

END 
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APPENDIX B 


WALSH AND HAAR FUNCTIONS AND MATRICES 


The increasingly familiar Walsh functions and the less 
well known Haar functions originated in the early 20th 
century. J. A. Barrett, as described by Fowle [11] was 
perhaps the first to discover Walsh functions, using them 
as the basis of a telegraph wire transposittion scheme to 
reduce crosstalk. J. L. Walsh in 1923 [12] formalized the 
set of complete orthogonal bivalued functions defined on the 
unit interval [0,1] which now bear his name. An important 
orthogonal but incomplete subset of the Walsh functions are 
the square-waves known as Rademacher functiions after H. A. 
Rademacher [13], who developed them as part of a unified 
theory of orthogonal functions in the early 20's. 

Much of the recent interest in applicattion of Walsh 
functions was stimulated by their adaptability to digital 
airowasenney For example, a discrete Walsh matrix, like the 
discrete Fourier matrix of sampled sinusoids, contains the 
symmetry and redundancy required for a Pays tmereRocar algo- 
rithm based on matrix factorization. Becawse of the bivalued 
nature of the functions, the fast Walsh transform on enny 
Walsh function based processing is inherently suited to 
digital implementation. Harmuth [14] proposes many and 
varied uses for Walsh functions in applications from signal 


processing to communication data multiplexing. 
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The set of Walsh functions of order N = 2” for all 
non-negative integers, n, forms an Abelian group under 
multiplication. That is, the product, equi-argument wise, 
of any two functions of the set is another member of the 
set. The first eight Walsh functions are shown below in 


Figure 22. 
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Figure 22. Continuous Walsh Functions of Order 8 
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The ordering shown here is the so-called sequency order 
after Harmuth who defines sequency as the average number 
of zero crossings per unit interval, (0,1). 

Harmuth chooses to define the Walsh functions on [-%,+%] 
and employs the notation Cal(s,x), Sal(s,x) to accentuate 
the symmetry similarities to the sinusoidal trigonometric 
functions. Sequency, s, is now defined as one-half the 
average number of zero crossings per unit interval [-%,+%). 

The discrete Walsh functions, W, (15k), I= Olle og Nal 
and k = 0,1,...,N-l1 are formed by sampling the continuous 
Walsh functions at N equally spaced points on the interval 
of definition. The discrete form is most conveniently 


shown in matrix form as in Figure 23, below. 


apap GR ape ap ge gb. a Wg (0,k) 
+ + + + = = = = We (15k) 
0 te Se ee We(2,k) 
+ + =- =- + + = = We (35k) 

Wo = = 

~8 PS) eam alae ae ene ela We (4,k) 
tees tp + F. = Wg (55k) 
es aime, ene Wg (65k) 
+ - + =- + = + = We (7.k) 


Figure 23. Walsh Sequency Matrix of Order 8 


The Haar functions form a complete orthogonal but non- 
orthonormal set of bivalued functions on [0,1], and were 
first published by A. Haar in 1909 [15]. This set is related 


to the set of Walsh functions as pointed out ByannOm lous 
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but appear considerably different. The orthogonal Haar 
functions attain values +l, -l, and O as shown below in 
Figure 24, which clearly illustrates the increasingly 
local nature of higher orders. The literature indexes 
Haar functions by a subscript and a superscript, a system 
which provides insight to the shape of a function from its 
indices but is somewhat clumsy for this work which employs 


a single subscript index. 


¢ 


Figure 24. Continuous Haar Functions of Order 8 
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This orthogonal set may be normalized by multiplying each 
orthogonal function by Qe where k is the sub-index 
in od. 

The discrete Haar functions of order N are formed, like 
the discrete Walsh functions, by sampling the continuous 
functions at N equally spaced DOmnee on the interval of 
definition. The N-square Haar matrix formed of the first 
N discrete Haar functions is shown in Figure 25 in orthogonal 


form. 


+ + + + + + + + 
ee inh ea See 
te iO eonO) (nO) KO 
He = 0.0 O OO oe ees 
toe — Om 105-0 050) 0 
OO Or o 0 © © 
On 0 10 ee OO 
OR Omen 0, 0 0 + - 


Figure 25. Orthogonal Haar Matrix of Order 8 


Both Walsh and Haar matrices contain high redundancy 
which has led to not only the fast transform algorithms but 
to a variety of generating methods based on their internal 
symmetry, [6], [16]-[20]. The fast Walsh and Haar algorithms 
used in this research are adapted from papers by Robinson 


[18] and Rejchrt [20] respectively. 
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APPENDIX C : 
GENERALIZED FOURIER SERIES 


Consider the infinite dimensional signal (vector) space, 
S, consisting of all continuous physically realizable signals 
(functions) defined on a < x < b. On this space is defined 
an inner product or projection operation 

b 
pe Se ead) Gc) idx. 
a 

S contains orthonormal systems of infinitely many vectors. 
Let E = {go> 81> e .--} be one such system. The 


aoee 9 =n? 


orthonormality condition states that the Sy satisfy 


Aes = Ol Or i 7 j 
31,5] iby Bee ab | 
for all non-negative integer indices i and j. 

An arbitrarily chosen signal, s(x), in S can be repre- 
sented by sequentially nested subsets of E, each of which 
spans a subspace of S. For clarity it should be noted that 
any segment of the real line can be considered an infinite 
dimensional vector space, hence s(x) can be expressed as 
S, depending on the context. 

The signal (vector) s possesses a "best" Sy approximator 


s, in the subspace S 


<All a 
where py = (seg) is the projection of s onto e,. In other 


spanned by Ey and is given by Sy = Po£q> 
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words, P80 is the vector in Ej which is by some measure 
closest to s of all vectors in E,- Similarly, s possesses 


a "best" S, approximator in E, 


By = gba 7 en 
= (seeo)&, + (s°s,)8) 


and a "best" Sy approximator computed in the same manner 


in E, = {€9281 280» mas &,-33 peep hatuelsy. 


Bin ~ Beso ¥ Pika of v Pepe 


By virtue of the orthogonality of the &3> each coefficient 
Py is invariant in the Sy approximations for k Z i=0,2,... 


The limiting approximator, 


is called the Fourier E-coefficient expansion of s, and the 
Coe isl cHentsm pin = (see,) are the Fourier E-eoefficients. 

As implied above, a Fourier E-coefficient expansion of 
S has the property that for each successive k = 1, 2, ..., 


the S, approximator formed of the first k terms is "best" 


k 
in the sense that there is no other vector "closer" to Ss 


implicit phere is thiaves aes: aiveleasit 


in the subspace S 


k* k 


as good as Sy-1" 
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"Closest" as used here is in the sense of Euclidean 
distance or the norm of the difference between the two vectors 


s and S;° "Best" implies that s, is the closest of all S 


k k 
approximators to s. To formalize the notion, the distance is 


given by 
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Ils - Sxl = mee ic ae 


To prove that Sx is the best Si approximator of s in the 


norm, choose an arbitrary S, approximator 
k 


and determine the coefficients Dy which makes the norm 


Ils - sp|| smallest, or equivalently, minimizes || s - sill° : 


lls - stl = (s- sf) © (gs - sf) 
k-1 k-1 k-1 
ARBOR oC A & pi Gece) nae a) DKIOS (Se OSs) 
j=0 J J 1=0 j=0 i j al a] 
2 k-1 k-1 B 
Sills" e220 Hotpep on the Mates) 
j=0 J j=0 
pe k-1 
} } 
Tlie tee Ola eee SAPD 
= j=0 
Thus Ds = P, = S°ey> (SOs aby 2a odio 5) Neal vals: taal eoorentales 


cient set which results in the best S, approximator. 
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The limiting case of the best Sy approximator does not 
imply that ve lls - sll = 0. It is conceivable that we 
can find an s which possesses components which are orthogonal 
to every vector in the infinite set E. One example is the 


infinite system 
Bode penal 1 3 
E = { See oe Selena (xs) as oT Sitin (250) ian sicee } 


Spanning the space of continuous functions defined on 
-™m<xesm. E is orthonormal and infinite, yet the best Sy 
approximator for f(x) = Acos(x) is zero for all k. This 
introduces the notion of completeness. An infinite ortho- 
normal system E is said to be a complete orthonormal system 
if for every seS, the norm | - sll 20 as kv 

To this point the discussion has been limited to contin- 
uous signal and infinite dimensional signal (vector) spaces. 
The results can be modified to cover finite dimensional, say 
N, signal spaces which are not unbounded, that is, the set 
of N-dimensional vectors whose elements are real numbers 
possible obtained by sampling the value of continuous 
functions at N equally spaced points on the interval 
a<x<b. It is implicitly assumed that the constraints 
placed by the sampling theorem are met. 

We define a discrete inner product operation on the 


space Sy as 
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where Ey = (fo> fi» oe fy-1? and Gy = (Eg> Byo sees By-1)° 
Hee Wy Suh eb 
orthonormal system spanning Sy- The gn are 1xN vectors 


-++5 Gy } be a discrete N-dimensional 


satisfying 


o To 
9,°S; = did, = Say : 


For any signal vector in Sy say Ss = (sp, Sy2 sees Sy-1) 


there is a best Sy approximator in the norm given by 


k-1 
Sx = 2 pd, bone MIL We Ea AL A tay ly 
i=0 
where 
T N-1 
Die Seoie So Re Soa : 


The N-dimensional system Dy is said to be a complete 


discrete orthonormal system if for every seS the norm 


N? 
Ils - s, ll = 0. 

In the above discussion, general orthonormal systems 
spanning continuous and discrete signal spaces have been 
considered. Nothing has been said about which orthonormal 
system or basis may be best suited to representation of a 
certain category of signals in the space. 

A given signal, vy, in the discrete signal space Sy 


possesses best S, approximators in every orthonormal basis 


k 


in Sy However the best Sy 


in general posses a greater or smaller norm error than the 


approximator in one basis will 


best S, approximator in another basis. Since there is an 
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infinite number of signals possible in S,,, the determination 


N 
of the best orthonormal basis to represent a particular 
category of signals by a truncated series, that is a Si. 


approximator, is more than a casual matter. 
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APPENDIX D 
TABULATION OF NUMERICAL RESULTS 


“SIGNAL SPACE 6-11 TO 18-12 


-F-RATIO VECTOR. NR SIG PER CLASS = 25 NR CLASSES = 28 
N GLOBAL MEAN F = RATIO RANK F = RATIO 
1 .222078307 .55055E+G1 28 .935782E+D4 
2 2286132872 .57295E+D1 27) 913577 EtD4 
3 0325046925 .57926E+G1 29 eS9DB4E+D4 
4 .341874228 .80339E91 26 22881 7EtD4 
De eC LAS 4 lec oo Ordo 3G .50G5GE+D4 
6 2591523519 .36908EtO1 25 A4O36TEHGA 
T eSA9ISSITE6§ 2. 75669EtD!1 24 .SID6SEHDA 
8 2347754392 .Sds540EtD1 Sl 38961 E94 
9 2343847632 .599355EtO1 41 .2e28s7E+54 

19 =.342832029 .S7TIS5E+91 45 .22955E+D4 
i eodloe LS4Ale lee EE oe 42S ic lope EA 
IB CS4eaSvagGa. GS iGisla i 20) eolAZo Eo 4 
“13 6 S44257712 0 «=. 65 022E01 59” ol Ss2rkn 4 
14 2344148649 .19725E+01 46 .18669E1+D4 
15 .3446689351 .58923E+D1 44 AITITLE+DA 
16 .344903975 .79927E+01 22 «6 L6895E+L4 
17) =.341718793) =. 296 49E+G2 $2 16522E+64 
‘18 2537812543 .14092E+93 38 .16063E+D4 
19 2536386681 .25212E+83 $3 o LS857TEZ4S 

20 2534472597 8.661 48E+B3S 45° .lSsoo ero 

21) 43346993589 .105358E+D4 534 .12911E+94 

22 «233584357557 J I1S895E+G4 37 212444E+94 

25 «425484648135 .21429Eto4 SG) sll oven 

24 .356815623 .31D68E+04 21 .19338E+64 

22 2967402315 .49367Et+D4A 35 .95942E+53 

26 2S80839996 .S8D1T7EtB4 46 .89299E+G3 

He eo co4el eo loonr TeteA 20 .S6148E+93 

28 e461757836 .93782E94 AT .98426E+23 

29 2498632874 .69094E+94 19 .25212E+035 

$8 411835968 .52050E+D4 48 .25078E+G3 

31 .419820395 .38961E+64 18 .14292E+93 

TABLE Dl. Feature Selector (F-Ratio) Test on Signal 


Samples of 20 Classes (6-11 to 10-12) 
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SIGNAL SPACE (CONT) 


32 4053718708 .16522E+64 
33 «2395888829 .135857E+04 
34 2381640675 .12911E+64 
35 2365371848 .95942H03 
36 2346074224 .,LITSTE+GA 
37) 922753906 .12444E+B4 
38 2298769534 .16063E+G4 
39 2278624995 .18825E+G4 
46 .242421865 .18669E+64 
Al 2213886738 .228678+24 
42 26185917914 .215558+64 
43 = .158691436 .229558+04 
44 41353320332 .ITITIE+G4 
45 108823142 .13855E+04 
46 2086152345 .89299E+93 
AT 266239476 .50426E+03 
48 .@48719942 .2587¢8E+23 
49 .956562510 .19491 293 
58 .829863276 .449138E+92 
51 827482349 .17336E+02 
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57 4827285166 .69157E+91 
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TABLE Dl. (continued) 
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F-RATIO VECTOR. 


6-11 


N GLOBAL MEAN 


1 2158054395 
2 28289091398 
5 907832460 
4 .003212961 
5 ~O02258487 
6 029839599 
T 888358398 
8 009244518 
9 668195182 
19 580114297 
11 888877852 
12 .809054494 
13. 930039765 
14 .990030612 
15 .9028029852 
16 .99991S115 
17 =.9608315185 
18 2089011138 
19 6802008543 
20 890009850 
21. 290889220 
22 980808538 
25 =.882906571 
24 829206548 
22 2999805898 
26 908005549 
27 969305772 
28 =. 990004928 
29 832085287 
$8 90909906183 
S31 .900004341 
TABLE D2. 


TO 10-12 


NR SIG PER CLASS = 


F - RATIO 


eS33560E+25 
049742E+ 65 
064962 E+ 05 
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0D SS65E+D4 
elADIDE+O4 
0 6856E+03 
e17927E+G3 
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oe 14263E+02 
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oS4680E+O1 
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e11594E+02 
e96354E+01 
e84680E+21 
oe TS446E+B1 
e 1303 4E+61 
eS2571 ED] 
e2TST4E+D1 
02D 7TODE+D1 
eDS858E+D1 
0 I58S5E+D1 
eD2TASE+O] 
e213 4E+01 
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Feature Selector (F-Ratio) Test on Fourier 


Magnitude Coefficients of 20 Classes 
(6-11 to 10-12) 
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WALSH 6-11 TO 18-12 


F-RATIO VECTOR. NR SIG PER CLASS = 25 NR CLASSES = 28 


N GLOBAL MEAN F - RATIO RANK F = RATIO 
1 421459854 .94382E+93 5 .135845E+O5 
2 =e2I6S571857 .18822Er02 6 .29463E+94 
3 188234492 .13845E+O5 9 e219316E*D4 
4 .181912975 .122708+64 25 e14192E+D4 
5 -el1ZQ6747738 .95880E+OS 21 13941 E+D4 
6 -.158544034 .29463E+D4 4 .12270E+G4 
7 852469358 .10585E+O4 19 .18815E+D4 
8 --022725660 .92342E+03 7 18585E+04 
9 -.814492664 .19316E+O4 26 69D TABE+DS 
18 -.8@28861068 .1G815E+G4 1 .94382E+93 
1! -.945914553 .43280E+93 5 e9588GErO3 
12 .624911135 .4A48538E+O3 8 .92342E+03 
15 -.863686222 .935368E+02 25 2 81742E+035 
14 -.885314587 .435180E+03 ST 4 69TSBE+DS 
15 0812225481 .12082E+92 24 «67505E+63 
16 -.@15699737 .52419E+G2 58 =e DABBSEtOS 
17 -.216392939 .4A9295E+B3 17) .49295E+83 
18 -~.911567336 .24585E+03 12 .48533E+935 
19 -.918360678 .40562E+G3 27 e44935E+G35 
20 -.826983893 .43928E+G3 20 .43928E+035 
21 -.814538482 .13941E+L4 11) .43280E+93 
22 --G1BB477T7I5 «256 46E+DS 14 .435188E+93 
23 -.815147123 .81742E+D3 19 .48562E+03 
24 -.915672214 .67595E+93 2G 2 S8519E ZS 
25 -e812974054 1419284 55 STSAIEHDS 
26 -.8@1672355T .957T40E+ 43 56 oe STST4E+ CS 
27 -.926574213 .~44955E+O3 SB .5S4832E+GS 
28 808189458 .38519E+83 DD ek ISS6EtDS 
29 -.054384355 .719927E+62 29 e26150E+ 83 
38 -.8463413068 .34832E+83 22 eZ ICGAGE+B3 


31 983344229 .83294E+B) 18 .24585E+B3 


TABLE D3. Feature Selector (F-Ratio) Test on Walsh 
Coefficients of 20 Classes (6-11 to 10-12) 
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1-2 Hey 
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= 22hJ9 879 OLS mM . KOTOR OF 
r, f — 


WALSH 6-11 TO 19-12 (CONT) 
‘32 -.003937508 .72821E+O1 
33 -.804391285 .94356E+02 
34 -.993328999 .55239E+82 
“35 -.905259998 .11896E+23 
36 -.987195756 .46071 E82 
37 -.993813875 .15540E+23 
38 -.892785032 .89413+02 
39 -.98939438035 .16422E+03 
“46 -.983647456 .11918E+G3 
41 -.805117728 .49212E+92 
42 -.O81877687 .8S7908EZ2 
43 -.9829385545 ,.53109E+¢2 
44 -.0@64845820 .315938+92 
“45 =-.0901935357 .327408+82 
46 -.603251178 .55945E+92 
AT -.9024738158 .5167GE+O2 
48 -.8080979369 .16399E+02 
49 -.898163791 .21978E+93 
58 -.905558838- .723513E+02 
51 -.099373251 .16398E+03 
52 - D1A4026146 .135224E+93 
53 -.097172187 .37941E+93 
54 -.895473697 .13029E+33 
55 -. 298266874 .27556E+93 
56 -.8828829946 .37574E+93 
57 -.986842355 .69750E+93 
58 -.9A8292417 .54888E+93 
59 -. 2138011700 .26150E+03 
6B 984154839 .23367E+93 
61 -.917182443 .36568E+02 
62 -.8023213081 .20571E+93 
‘(63 981648158 .70162E+01 
TABLE D3. (continued) 
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HAAR Ca Om nO = 2 


F-RATIO VECTOR. NR SIG PER CLASS = 25 NR CLASSES = 20 


N GLOBAL MEAN F - RATIO RANK F = RATIO 

1 421459854 .94382E03 5 8595 4E+B4 
2 -.067979291 .58147EtB4 12 eA4AL875E+D4 
3 322869426 .11542E+94 2 eS8lL47E+O4 

4 -.952418254 .51611E+21 25 e29081E+B4 

D5 -.853656437T .65954E+D4  §& .299335E+04 

6 206892520 .29033EtD4 24 e27113E+04 

7 984212818 16141 E+S3 27 e209358EtO4 
8 -.9791458!19 .52838Et+91 13. 2 18742E+84 

9 .e099045885 .30722E81 19 .18237E+04 
168 .821146692 .18237E+o4 22 215999E+B4 
11 -.925410343 .78754E+23 26 2 126357E+D4 
12 856869388 .41875E+04 25 212631 E+D4 
13. 2874749634 .18742E+D4 21 .11728E+D4 
14 .896280228 .14284E+O3 3 e11542E+24 
15 0080843196 .50746E+D1 1 .94382E+35 
16 -.967468256 .47S37EtO1 1] 67875 4E+93 
17 -.6030999656 .46635E+S1 AB .58286E+GS 
18 .@21861915 .594084E+01 AT 963 49E+D3S 
19 -.@88485979 .71I514E+O1 5B eDADTSE+OS 
20 0830802785 .17618E+O3 49 49981 E+53 
21 -.084978226 .11728E04 51 .41726E+93 
22 -.812486218 .13999E+04 25 2 S8915E+935 
235 -e293240537 .12631E+G4 43 «S4455E4+03 
24 914816557 .27113 E04 D4 232788 E+B3 
25 825838614 .29081E+04 44 .31620E+03 
26 029086350539 .12657E+G4 45, «29983E+93 
27) 2623341142 .20938E+G4 Zone ec HOSS ERS 
26 907274961 .27999Et9S 46 .23718E+93 
29 -.908141846 .11623E+62 D2 occ OU EROS 
$3 8806250979 .65944E+G1 Do) ecllZZeros 
$1 -.9080045565 .58745E+01 20 e17T618E+GS 


Feature Selector (F-Ratio) Test on Haar 


TABLE D4. 
Coefficients of 20 Classes (6-11 to 10-12) 
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HAAR 6-11 TO 10-12 CCONT) 
32 -.034772977T .44496E+DB1 
33 -.8013562197 .A466935E+G1 
34 -.902439418 .39371 E91 
35 800854119 .25150E+91 
36 081427832 .24882H 81 
37 808458961 .48432E+21 
38 -.0900580905 .37468E91 
39 ~-.998193610 .23888E+61 
40 O90841666 .88559E+G1 
41 809527525 .20209E+G2 
42 -.-080041910 .19548E+33 
43 - 992936369 .54455E+93 
44 -,.994171491 oD 1620E+83 
45 -.994217939 .299083E+83 
46 -.022539818 .23713EtdS 
47 eD89350982 563 49E+03 
48 993491787 .58286E+05 
49 805964154 .49981E+93 
56 0085660941 .545735!4+83 
5] 910345957 .41728E+23 
52 8182499693 .22990E+83 
53 .G168017596 .211228+03 
54 9999986535 .S27888t+23 
55 867324575 .38915E+53 
56 eB94464616 .14941E+03 
57 2880994510 .~23668E+22 
58 -.908286508 .95778EtD1 
59 988221330 .S5967F+61 
6G .8289250633 .64988E+81 
61 -.002114483 .63893E+9 1 
62 -.O908800069 .63902Et+91 
63 9009507352 .64573E+31 
TABLE D4. (continued) 
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‘FOURIER 


F-RATIO VECTOR. WR SIG PER CLASS = 


25 NR CLASSES 


N GLOBAL MEAN F - RATIO RANK F = RATIO 
» Lt 244911253 .13646E+07 1 .13646E+07 
2 289380544873 .11S54E+07 2 .2lL1854E+07 
8 997437990 .29563E+96 3 .295635E+96 
4 .8941209382 .25194E+96 4 .25194EF+06 
5 .A8@2111879 .63064E+O5 5 6386 4E+05 
6 .2800865536 .12963H+05 6 .12963E+25 
T .90980325381 .98581E+D4 7 .985818+04 
8 2880240613 .293928+94 8 .29392E+34 
9 .8@8020155630 .892235+93 9 .89223E+83 
10 .ABAGSSE75 .5B438E+B3 10 .58438E+03 
11 882865638 .241398+63 11 .241398+93 
12 .@0929043446 .15983E+93 12 .15983E+03 
13 .O@80832658 .98446E+H2 14 .~116215+83 
14. .0800923340 .11621E+63 13 .98446E+92 
15 .@9980162735 .94626E+02 15. .94626F+082 
16 .@00012276 .75674E+02 17 .79197E+22 
17 .2868918168 .79197TE+B2 16 .75074E+82 
18 .988288259 .66924E+92 18 .669245+02 
19 .@@2006182 .41279E+02 26 .27435E+602 
26 .O20806026 588264102 24 .519298+392 
21 .8@8@89605957 .50573E+G2 2S SOOM arlae 
22 .~OO08004969 .506882E+02 22 20682E+22 
25 998984456 .51833E+22 21 .595735E+G62 
24 099034895 .51929E+92 20 .29826E+82 
25 ~O@88293874 .36995E+22 27 .~49959E+22 
26 8809003587 .574355E+22 $38 .42875E+G2 
27 .808083761 eo 4593 0E+92 19 .41279E+82 
28 06209835032 .36979F+ 02 25 .36995E+62 
29 .JOGAG3664 ec I SOSEFO2 28 eS69T9E+B2 
36 .820203656 .42875E+02 3] 00879 4E+02 
31 ef OB9B03202 .38794E+02 29) eh I695E+B2 
TABLE D5. Feature Selector (F-—Ratio) Test on Fourier 


Magnitude Coefficients of 79 Classes 
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FOURIER 


SECOND MOMENTS. NR CLASSES = 79 


GLOBAL WEIGHTED 


“WID MOMENT 


N GLOBAL MEAN WTD MOMENT RANK 
1 22448911253 .81307E+85 1 .81387E+85 
2 830544873 .34596E+85 2 2 54596E+25 
3 887437990 .335545E+05 3 e335 45E+85 
-4A 884129382 .171858+05 4 .17185E+85 
5 .e62111879 .72855E+D4 5 ~72055E+04 
6 e088865536 49743 E+03 6 .49743E+93 
7 888325381 .19427E+93 T .19427E+083 
Bg 028240613 .8S671E+O2 8 .-S8671E+G2 
9 989155639 .J.51498F+02 9 .D1498E+02 
10 .@223996675 .37999E+62 10)» =.37999E+G2 
11 2208265638 .&3954E+D1 11 08995 4E+B 1 
12 .832€43440 .S7TTTTE+D! 12 .ST7T7TTE+O) 
13. .@20930658 .29259E+O01 17 .45425E+01 
14. .899023340 .425¢02+301 14 .425025+@1 
15 .9080916273 .323818+01 15 ,32881E+@1 
16 .089¢12276 .22esgl7Etol 13 .292598+61 
17 .99@@10168 .454255+51 22 ehh 202E+O1 
18 289098259 18282821 16) .22817E+21 
19 8802926182 .I3S818EtO1 25 .191798+81 
99 202006026 .19I179E+51 18 .182825E+81 
9 eOB2ZA905957T .J14677Et+51 2] el8179=2+01 
22 ,MVdIZAIGS 2620201 27 = 217297E+D1 
93) 6. 809884456 .12987E+S1 3@ .16634E+01 
PA 035094995 .155775+0)1 2’ ol 6286F+91 
95 882003874 .16256Et+D1 24 .15577E+9)1 
26 8280083587 .1817SEtS1 28 -148128F+81 
27 2088283761 172978481 31 .14747E+61 
98 .@82803332 .14810E+61 21 el4677E+81 
29 .Y82283664 .9B35TETED 19 .13818E+S1 
36H .8092803656 .16634E+31 23 e~12907E+D1 
31 20080293202 ,14747E+01 29) -98337E+DB 
TABLE D6. Feature Selector (G-Variance Ratio) Test on 


Fourier Magnitude Coefficients of 79 Classes 
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WALSH 


WR CLASSES = 


F-RATIO VECTOR. NR SIG PER CLASS = 25 79 
N GLOBAL MEAN F - RATIO RANK F - RATIO 
1 .565311798 .18709E+O5 5 .19245E+05 
2 -.217285603 .385698+H4 1 .187089%+085 
3 2193944555 .11957E+65 4 184012 E+05 
4 -.053118689 .18401E+05 29 .12934E+95 
5 -.180918634 .19245E+05 3 .11957E+O5 
6 -.187729935 .232092+04 28 e11363E+05 
T 8380655844 .19884E+C4 13. .103768%+85 
8 -.9406S5889 .34298E+04 12 .S97T268E+D4 
9 -.944336251 .33474E+04 27 64322E+94 

18° -.922559818 .42224E+G4 11 .59864E+94 

11 -.829491168 .59864E+G4 66 .S5136E+B4 

12 -.842918292 .97208E+O4 61 .43864E+04 

13 -.1282987796 .1@376E+25 10 .42024E+04 

14 -.969822848 .&2600E+083 25 .41552E+24 

15 .091948256 .30388E+03 26 .40892E+04 

16 -.0816583!100 .45342693 2 .38569E+04 

17 -.9205651803 .11594E+G4 21 .36362E+04 

18 -.911698609 .16507E+B4 59 .34952E+B4 

19 -.915326899 .27382E+04 20 .34443E+04 

-20 -.9169038990 .34443E+94 8 .3429SE+D4 

21 -.812256719 .36362E+84 23 = SA4ADISE+DA 

22 -.@17078927T .27946E+94 24 .SS631E+04 

23 -.013291242 .34815E+84 9 .33474E+04 

24 -.022318721 .336318+94 22 =e21946E+04 

25 -.825561351 .41552E+24 19 .27382E+04 

26 -.915324937 .45892E+04 57) 625 T6AE+D4 

27 -.O@17566111 .64322E+G4 6 .25209E+B4 

Zor eo OeoNleldlson sliSGSERGS 58 e21546E+G4 

29 -.952535623 .12934E+05 56 e209B2E+D4 

38 -.937349686 .11378E+84 7- ~19884E+94 

31 -.000379351 .218225+83 52 Oe LTSISE+D4 

TABLE D7. Feature Selector (F-Ratio) Test on Walsh 


Coefficients of 79 Classes 
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WALSH (CONT) 


32 -.9802763121 oSO6TTE+B2 
33 -2993858594 .16422E+83 
34 -e9D1771946 .1L4446E+03 
35 ~-802504065 .S31LIE+BS 
36 ~-.002813622 .59134E+83 
37 -.981659894 .48991E+33 
38 -2902616133 .350749E+B3 
39 -.081999825 .47213E+O3 
46 -.-900862905 .37863E+93 
41 -.992232825 .27667E+03 
42 -.801120716 .21317E+9S 
43 -.981534370 .17858E+93 
44 -.901999636 .21086E+D3 
45 -.008131854 .17827E+DS 
46 - OH13STTIIG .20433E+D3 
47 -.09805922381 .17193E+03 
48 -. 827560768 .16286E+03 
49 -.209521550 .53684E+03 
50 -.005135024 .56949E+H3 
51 -.826912556 .10275E+B4 
52 -.€07238756 .17819EtD4 
53 -.@05216978 .14643E+D4 
54 -,907€28495 .12274E+04 
55 -.006029200 .15446E+B4 
56 -. 910537105 .20902E+94 
57 -.212213166 2.2576 4E+04 
58 -.O96929713 .21546E+04 
59 -.@O08100864 .349328+04 
62 -.819843758 .55136E+04 
61 -.225686976 .43564E+04 
62 -.G18169586 .977Z1EtBS 
63 280486727 .60132E02 
TABLE D7. (continued) 
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WALSH 


GLOBAL WEIGHTED SECOND MOMENTS. NR CLASSES = 79 


N GLOBAL MEAN WTD MOMENT RANK WID MOMENT 
1 .565311798 .13559HE+24 4A .871658E+04 
2 ~e2ll2s5605 .STSSlEto2 5 42234E+04 
3 21803944555 .31266E+04 3 eSIAZ6E6E+D4 
4 -.953118689 .87650E+04 12 .13955E+04 
5 -.180918634 .42234E+94 1 .13590E+@4 
6 -.127789335 .32753E+83 13. 6 767925+83 
T 038635244 .27490E+23 19 .62367E+93 
QB - G42665889 .45347E+83 28 .50915E+B3 
9 -.844336951 .28946E+93 ll .47813Et+93 
19 -.822559818 .62367E+03 8 e45347E+D3 
11 -.829491168 .47813E+83 29 .94414E+03 
12 -.942218292 .13955E+04 6 .32753E+93 
135 -.192987796 .767925+23 9 .28946E+D3 
14 -.869822848 .35172E+9#2 T e27TASBDE+DS 
15 .881948256 .98932H21 27 e28488E+035 
16 -.816583108 .11939E+92 26) .252258+83 
17 -.020561803 .473888&+62 26 .19883E+23 
1g -.811698699 .49247E+22 25 .19784E+03 
19 -.815326899 .77826E+62 24 .18797E+83 
20 -.816930990 .19883E+83 22 .14856E+03 
21 -.812256719 .12389E+93 60 .12543E+23 
22 --O17078027T .14856E+23 21 .12389E+03 
23 -.013291242 .11665E+83 23 .11665E+63 
24 -.022318721 ~l879TE+B3S 61 e 1\SZ9SE+B3 
25 -.025561351 .19764E+93 59 .8935125+82 
26 -.9133824937 .232255+83 19 .77826E+02 
27 -.817566111 .264885+03 2 .S67881E+82 
28 --823117185 .50915E+83 56 .62724E+02 
29 -.852535623 86.3441 4E+83 58 .249439E+22 
30 -.057S486E6 .28778E+L2 18 .49247E+02 
31 -.008379351 .48499E+91 57 ATT5S6E+92 
TABLE D8. Feature Selector (G-Variance Ratio) Test on 


Walsh Coefficients of 79 Classes 
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WALSH (CONT) 


32 -.002763121 .16543E+01 
33 -.293858594 .35432S6E+01 
34 -.001771946 .52938E+01 
35 -.082504065 .85940E+D1 
36 -.0828135622 .15359E+82 
37 --83166S894 .1318SE+02 
38 -.-09926161335 .59670E+91 
39 -.-991990825 .95801E+G1 
48 -.020862905 .772268+21 
41 72892232825 .88924E+31 
42 -.901120716 .53087E+O1 
43 -29%1534378 .58344E+91 
44 -.991999636 .I1BI7T5E+G2 
45 -.-992131854 .51846E+G1 
46 -.O81377116 .453028381 
47 --9980502281 .58544E+91 
48 -2997560768 .21936E+91 
49 -.989521558 .98725E+D) 
52 -.005135824 .94851 E+E 1 
51 -.826912556 .24274E+62 
59 -.097238736 .36842E+02 
53 -.025216978 .28266E+G2 
54 -.0087828495 .23895E+22 
55 -.096029208 .34456F+92 
56 -. 918537195 .62724E+G2 
57 -. 12210166 .47756E+¢2 
58 -.986003713 .494359E+82 
59 -. O8810G864 .89312E+22 
62 -.2@10843758 .125435+03 
61 -.925686976 .128899E+63 
62 -.H18169586 .27122kG2 
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